Interactive learning system and a method

ABSTRACT

An interactive learning system and method are provided. The method includes projecting at least one multimedia on a display screen interface upon selection of the at least one multimedia by a user, receiving one or more images representative of the at least one movement of corresponding one or more interactive tools captured by an image capturing unit in real time, enabling an interaction with at least one multimedia being displayed on the display screen interface upon having at least one movement of the one or more interactive tools on pad, identifying a pattern formed by the one or more received images representative of the at least one movement of the one or more interactive tools, analysing the pattern identified via an image processing technique, enabling an interaction of the one or more interactive tools with the at least one multimedia being displayed on the display screen interface in real time.

This International Application claims priority from a complete patentapplication filed in India having Patent Application No. 202041013877,filed on Mar. 30, 2020 and titled “AN INTERACTIVE LEARNING SYSTEM AND AMETHOD”.

FIELD OF INVENTION

Embodiment of a present invention relates to an interactive system, andmore particularly, to an interactive learning system and method.

BACKGROUND

With a linear growth in technology, electronic devices are becoming moreuser friendly. One of the major applications of technology in recentdays is education and entertainment; and one such entertainment isgaming Various games and toys have been developed in which a computingdevice interacts with a physical location of a game controller to keepthe games engaged.

Game controllers come in various forms such as keyboards, mouse,gamepads, steering wheels, light guns, joysticks, playing pieces or thelike which is used in various platforms such as virtual reality,augmented reality, flat screens or the like to experience 2-dimensionalor 3-dimensional effect of the game. Further there have been an attemptto construct various board games with the combination of flat screenssuch as a display screen interface and interactive pieces or interactivetools such as patterns, counts, links, instruments, or the like.

In this context, users are in constant exposure to devices having thedisplay screen interface making it desirable to provide newtechnologies, which can enhance the interactive experience with touchscreen devices and their existing game controllers and devices havingsuch an interaction.

In one approach, augmented reality or virtual reality is used in thisregard which keeps the user engaged. However, such systems make a userlose the hands-on with the interaction associated to education orentertainment display screen interface. Also, user experience in such anapproach is limited to a single approach, thereby making theconventional approach less reliable. In addition, accuracy of trackingthe interactive tools in real time is a challenge as intervention ofnoise from any of the communication means may hamper the same or createa time delay in tracing the interaction of the game controller with thecomputing device.

Hence, there is a need for an improved interactive learning system andmethod in order to address the aforementioned issues.

BRIEF DESCRIPTION

In accordance with an embodiment of the present disclosure, aninteractive learning system is provided. The system includes a padincluding a plurality of sections. The plurality of sections includes afirst section including a slot. A display screen interface comprising animage capturing unit is housed within the slot. The plurality ofsections also includes a second section with a pre-defined magneticpattern. The pre-defined magnetic pattern is embedded within the pad.The system also includes one or more interactive tools which includesmagnetic material. The one or more interactive tools are configured toenable an interaction with at least one multimedia being displayed onthe display screen interface upon having at least one movement of theone or more interactive tools on the second section of the pad. Thesystem also includes one or more processors operatively coupled to thepad. The one or more processors incudes a multimedia projection moduleconfigured to project the at least one multimedia on the display screeninterface upon selection of the at least one multimedia by a user. Theone or more processors also includes an image receiving moduleconfigured to receive one or more images representative of the at leastone movement of the corresponding one or more interactive tools capturedby the image capturing unit in real time. The one or more processorsalso includes an image identification module configured to identify apattern formed by the one or more images representative of the at leastone movement of the corresponding one or more interactive tools receivedby the image receiving module. The one or more processors also includesan image analysis module configured to analyse the pattern identified bythe image identification module via an image processing technique. Theone or more processors also includes a tool interaction moduleconfigured to enable an interaction of the one or more interactive toolswith the at least one multimedia being displayed on the display screeninterface in real time based on the pattern analysed by the imageanalysis module.

In accordance with an embodiment of the present disclosure, a method forinteractive learning is provided. The method includes projecting atleast one multimedia on a display screen interface upon selection of theat least one multimedia by a user. The method also includes receivingone or more images representative of the at least one movement ofcorresponding one or more interactive tools captured by an imagecapturing unit in real time. receiving the one or more imagesrepresentative of the at least one movement of corresponding one or moreinteractive tools includes enabling an interaction with at least onemultimedia being displayed on the display screen interface upon havingat least one movement of the one or more interactive tools on pad. Themethod also includes identifying a pattern formed by the one or morereceived images representative of the at least one movement of thecorresponding one or more interactive tools. The method also includesanalysing the pattern identified via an image processing technique. Themethod also includes enabling an interaction of the one or moreinteractive tools with the at least one multimedia being displayed onthe display screen interface in real time based on the pattern analysed.

To further clarify the advantages and features of the presentdisclosure, a more particular description of the disclosure will followby reference to specific embodiments thereof, which are illustrated inthe appended figures. It is to be appreciated that these figures depictonly typical embodiments of the disclosure and are therefore not to beconsidered limiting in scope. The disclosure will be described andexplained with additional specificity and detail with the appendedfigures.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure will be described and explained with additionalspecificity and detail with the accompanying figures in which:

FIG. 1 is a block diagram representation of an interactive learningsystem in accordance with an embodiment of the present disclosure;

FIG. 2 is a block diagram representing a processor of FIG. 1 inaccordance with an embodiment of the present disclosure;

FIG. 3 is schematic representation of an exemplary embodimentrepresenting a tablet as a computing device with multiple rings andmultiple spikes being one or more interactive tools of FIG. 1 inaccordance with an embodiment of the present disclosure;

FIG. 4a and FIG. 4b are schematic representations of one or moreinteractive tools comprising multiple letters, of FIG. 1 in accordancewith an embodiment of the present disclosure;

FIG. 5a and FIG. 5b are schematic representations of the one or moreinteractive tool being a slingshot, of FIG. 1 in accordance with anembodiment of the present disclosure;

FIG. 6 is a schematic representation of yet another embodiment of theinteractive learning system representing a laptop as the computingdevice, of FIG. 1 in accordance with an embodiment of the presentdisclosure;

FIG. 7 includes FIG. 7a and FIG. 7b which are schematic representationof a system for interactive piano in a front view and a back viewrespectively in accordance of an embodiment of the present disclosure;

FIG. 8 is a block diagram of a computer 140 or a server in accordancewith an embodiment of the present disclosure; and

FIG. 9 is a flow chart representing the steps involved in a method forinteractive learning in accordance with an embodiment of the presentdisclosure.

Further, those skilled in the art will appreciate that elements in thefigures are illustrated for simplicity and may not have necessarily beendrawn to scale. Furthermore, in terms of the construction of the device,multiple components of the device may have been represented in thefigures by conventional symbols, and the figures may show only thosespecific details that are pertinent to understanding the embodiments ofthe present disclosure so as not to obscure the figures with detailsthat will be readily apparent to those skilled in the art having thebenefit of the description herein.

DETAILED DESCRIPTION

For the purpose of promoting an understanding of the principles of thedisclosure, reference will now be made to the embodiment illustrated inthe figures and specific language will be used to describe them. It willnevertheless be understood that no limitation of the scope of thedisclosure is thereby intended. Such alterations and furthermodifications in the illustrated system, and such further applicationsof the principles of the disclosure as would normally occur to thoseskilled in the art are to be construed as being within the scope of thepresent disclosure.

The terms “comprises”, “comprising”, or any other variations thereof,are intended to cover a non-exclusive inclusion, such that a process ormethod that comprises a list of steps does not include only those stepsbut may include other steps not expressly listed or inherent to such aprocess or method. Similarly, one or more devices or sub-systems orelements or structures or components preceded by “comprises . . . a”does not, without more constraints, preclude the existence of otherdevices, sub-systems, elements, structures, components, additionaldevices, additional sub-systems, additional elements, additionalstructures or additional components. Appearances of the phrase “in anembodiment”, “in another embodiment” and similar language throughoutthis specification may, but not necessarily do, all refer to the sameembodiment.

Unless otherwise defined, all technical and scientific terms used hereinhave the same meaning as commonly understood by those skilled in the artto which this disclosure belongs. The system, methods, and examplesprovided herein are only illustrative and not intended to be limiting.

In the following specification and the claims, reference will be made toa number of terms, which shall be defined to have the followingmeanings. The singular forms “a”, “an”, and “the” include pluralreferences unless the context clearly dictates otherwise.

Embodiments of the present disclosure relate to an interactive learningsystem and method. As used herein, the term ‘interactive learning’ isdefined as a type of interaction developed to learn, educate orentertain a user through different tools.

FIG. 1 is a block diagram representations of an interactive learningsystem 10 in accordance with an embodiment of the present disclosure.The system 10 includes a pad 20 which includes multiple sections 30. Inone embodiment, the pad 20 which may be referred to a mat may becomposed of rubber.

Further, the multiple sections 30 include a first section 30 a and asecond section 30 b. The first section 30 a includes a slot 40. Adisplay screen interface 50 including an image capturing unit 60 ishoused within the slot 40. Further, the second section 30 b includes apre-defined magnetic pattern 70 which is embedded within the pad at thesecond section 30 b. In one embodiment, the slot 40 includes a spring tohold the display screen interface within the slot 40. In suchembodiment, the display screen interface 50 may be placed vertically orupright at an appropriate angle from the pad 20.

In one specific embodiment, the image capturing unit 60 may include acamera embedded within the display screen interface. In one specificembodiment, the display screen interface 50 may be embedded within auser device. In one embodiment, the user device may be a portablecomputing device such as a laptop. In another embodiment, the userdevice may be a fixed computing device such as a desktop. In yet anotherembodiment, the user device may be a handheld portable device such as atablet, a mobile phone, or the like.

In one exemplary embodiment, the multiple sections 30 may also include amid section 30 c. In such embodiment, the pad 20 may include multiplefolding in between each of the multiple sections 30 which may be used tofold the pad 20 for portable purposes. In another exemplary embodiment,the second section 30 b is placed at a pre-defined distance from theimage capturing unit 60. The pre-defined distance may be a field of viewof the image capturing unit 60.

In one embodiment, the second section 30 b of the pad 20 may include oneor more reference points 75 which may be represented in a form of set ofdots on the pad 20. The set of dots may be considered as thecorresponding one or more reference points 75 for the field of view ofthe image capturing unit 60.

Furthermore, the system 10 includes one or more interactive tools 80which are operatively coupled to the second section 30 b. In oneembodiment, the one or more interactive tools 80 may include magneticmaterial which may be embedded within the corresponding one or moreinteractive tools 80. In such embodiment, placement of the one or moreinteractive tools 80 when placed on the corresponding one or morereference points 75 may be attached or positioned in place due to themagnetic material on the pad 20 and the one or more interactive tools80. More specifically, in such embodiments, the one or more interactivetools 80 may be magnetically coupled to the second section 30 b of thepad via magnetic material of the one or more interactive tools 80 andthe magnetic material at the second section 30 b.

Further, the one or more interactive tools 80 enables an interactionwith at least one multimedia 55 being displayed on the display screeninterface 50 upon having at least one movement of the one or moreinteractive tools 80 on the second section 30 b of the pad 20.

In one exemplary embodiment, the one or more interactive tools 80 mayinclude one of multiple patterns, multiple of designs, game equipment ora combination thereof. In such embodiment, the one or more interactivetools 80 may be configured in correspondence with the at least onemultimedia 55 being displayed on the display screen interface 50.Furthermore, each of the one or more interactive tools 80 may include atleast one tag point 85. The at least one tag point 85 may be of apre-defined shape such as a circle, square, rectangle, or the like. Thepre-defined shape may also include a corresponding pre-defined measurepoints. Further, when the one or more interactive tools 80 with thecorresponding at least one tag point 85 is placed on the second section30 b of the pad 20, the at least one tag point 85 may act as a referencefor the field of view of the image capturing unit 60. Furthermore, thesystem 10 includes one or more processors 90 operatively coupled to thepad 20.

FIG. 2 is a block diagram representing the processor of FIG. 1 inaccordance with an embodiment of the present disclosure. The one or moreprocessors 90 include a multimedia 55 projection module 100 to projectthe at least one multimedia 55 on the display screen interface 50 uponselection of the at least one multimedia 55 by a user. Morespecifically, the display screen interface 50 may display a list ofmultimedia 55, from which the user may select the at least onemultimedia 55 of interest. Further, based on the selected at least onemultimedia 55, the corresponding one or more interactive tools 80 may beused by the user to enable the interaction of the at least onemultimedia 55 selected.

The one or more processors 90 also includes an image identificationmodule 110 to identify a pattern formed by the one or more imagesrepresentative of the at least one movement of the corresponding one ormore interactive tools 80 received by an image receiving module 110.More specifically, as the one or more interactive tools 80 are operatedby the user on the second section 30 b of the pad 20, the imagecapturing unit 60 captures one or more images of the corresponding oneor more interactive tools 80 in real time. The one or more imagescaptured generates the pattern when synced together. The patterngenerated is identified by the image identification module 120 tosubsequently identify the at least one movement of the corresponding oneor more interactive tools 80. Upon identification of the pattern, thepattern is the analysed by an image analysis module 130 using an imageprocessing technique. In one exemplary embodiment, the at least onemovement may be one of a linear movement, a circular movement, arotational movement or a combination thereof. In one embodiment, theimage processing technique may include cropping feel of the one or moreimages to minimise size of multiple pixels of the corresponding one ormore images. Further, a gaussian blur technique is applied on one ormore cropped images to reduce noise and eliminate additional imagesand/or environmental factors in the one or more images obtained by theimage capturing unit 60.

Furthermore, one or more noise reduced images are converted from red,green and blue (RGB) to hue, saturation and value (HSV) images to obtainone or more hue images. In addition, the one or more noise reducedimages are converted from red, green and blue (RGB) to grey scale toobtain one or more grey scale images. Furthermore, contrast edgedetection processing technique is applied on the one or more hue imagesand the one or more grey scale images to obtain multiple edges from thecorresponding one or more hue images and the one or more grey scaleimages.

The multiple edges obtained are further subjected to diluting to joinmultiple broken lines in the corresponding multiple edges to obtain oneor more edge processed images. Further a pattern recognition techniqueis applied to the obtain one or more edge processed images to identifythe pattern of the corresponding at least one tag point 85. In oneembodiment, the pattern of the corresponding at least one tag point 85may be a square, a circle, a rectangle, or the like. Further, a set ofpre-defined filter values are applied to the one or more edge processedimages to obtain multiple edges of interest. In one embodiment, the setof pre-defined filter values may include a height, a width, a length, anarea.

Furthermore, a loop is created to match the multiple edges of interestusing a set of pre-defined markers to obtain multiple matched edges. Anorientation invariance technique is applied on the multiple matchededges or obtain multiple oriented edges. In one embodiment, theorientation may be to rotate each of the multiple edges by about 30degree to match with the adjacent multiple edges. Consequently, colourinside edge counters of the multiple oriented edges are detected todetermine if the obtained area if of interest of the interaction of theone or more interactive tools with the at least one multimedia 55 and tosegregate between different one or more interactive tools 80.

Further, a frame to frame difference mapping is applied to determine theat least one movement of the one or more interactive tools 80 on thesecond section 30 b of the pad 20. In one embodiment, the at least onemovement may be determined upon calculating delta values in ‘X’, ‘Y’ and‘Z’ directions. The rotation of the one or more interactive tools 80 maybe obtained upon calculating an axis and angle of rotation of the one ormore interactive tools 80.

The one or more processors 90 further includes a tool interaction module140 to enable an interaction of the one or more interactive tools 80 asshown in FIG. 1 with the at least one multimedia 55 being displayed onthe display screen interface 50 in real time based on the patternanalysed by the image analysis module 130. More specifically, as theuser operates the one or more interactive tools 80 (as shown in FIG. 1),the image capturing unit 60 captures the one or more images of the oneor more interactive tools 80 and transmits the one or more imagescaptured to image identification module 120 to identify the patterncaused due to the at least one movement of the one or more interactivetools 80 which is analysed by the image analysis module 130 which enablethe interaction between the one or more interactive tools 80 and the atleast one multimedia 55 being displayed on the display screen interface50.

In one exemplary embodiment, the tool interaction module 140 may trackthe at least one movement of the corresponding one or more interactivetools 80 based on the pattern analysed by the image analysis module 130,thereby enabling the real time interaction of the one or moreinteractive tools 80 with the at least one multimedia 55.

In one embodiment, the one or more processors 90 may further include anotification generation module to generate a notification if the one ormore interactive tools 80 are not in field of view of the imagecapturing unit 60. In such embodiment, the notification may be one of atext notification, a voice notification, a multimedia 55 notification orthe like.

FIG. 3 is schematic representation of an exemplary embodiment 150representing the tablet as the computing device with multiple rings andmultiple spikes being one or more interactive tools of FIG. 1 inaccordance with an embodiment of the present disclosure. The tablet 160a is fixed to the slot 40 in the first section 30 a. The display screeninterface 50 of the tablet 160 a is placed vertically to the pad 20 andhaving the camera 60 in field of view of the second section 30 b. Theinteractive tool 80 includes a semi-circular base 80 a on which themultiple spikes 80 b is fabricated. The semi-circular base 80 a includesmagnetic material which is used to fix the interactive tool 80 with thepre-defined magnetic pattern on the second section 30 b.

One or more of the multiple rings 80 c are placed on the correspondingmultiple spikes 80 b as a gesture of interaction with the at least onemultimedia 55 being displayed on the display screen interface 50.Furthermore, the user selects the at least one multimedia 55 to bedisplayed on the display screen interface 50. The multimedia 55projection module 100 projects the at least one multimedia 55 on thedisplay screen interface 50 of the tablet 160 a. Further to the set ofquestioners being displayed on the display screen interface 50, the useradds one or more rings 80 c on the corresponding multiple spikes 80 b togenerate a set of replays for the set of questioners of the at least onemultimedia 55 being displayed. The camera 60 captures the images of theone or more rings 80 c added by the user and the one or more images arereceived by the image receiving module 110 in real time. Further, theimage identification module 120 identifies the pattern formed by thecorresponding one or more rings 80 c and transmits the same to the imageanalysis module 130. The identification module 120 identifies thepattern formed by the one or more rings 80 c and is further analysed bythe image analysis module 130 using the image processing technique. Theanalysed image is further mapped to the set of questioners and verifiedbased on a set of pre-stored answers. Consequently, based on theanalysed and verified data, the tool interaction module 140 enables theinteraction of the one or more rings 80 c with the at least onemultimedia 55 being displayed on the display screen interface 50 in realtime. Also, the movement of the multiple rings 80 c on the correspondingmultiple spikes 80 b are tracked by the tool interaction module 140 inreal time. In one embodiment, the multiple rings 80 c may includenumbers or operators.

FIG. 4a and FIG. 4b are schematic representations of one or moreinteractive tools comprising multiple letters, of FIG. 1 in accordancewith an embodiment of the present disclosure. The interactive tool 80includes a stand 80 d, a letter trunk 80 f to hold one or more lettertiles, a tile placement stand 80 e coupled to the letter trunk 80 f toplace the one or more letter tiles from the letter trunk 80 f to enablethe interaction as a set of solution for the set of questioners beingdisplayed on the display screen interface 50 of the computing device.The one or more letter tiles placed on the tile placement stand 80 e bythe user is captured by the image capturing unit 60 of the computingdevice and the rest of the procedure follows as described above.

FIG. 5a and FIG. 5b are schematic representations of the one or moreinteractive tools 80 of (FIG. 1) being a slingshot, in accordance withan embodiment of the present disclosure. The sling shot 80 includes abase 80 g, a rotatable top 80 h, a sling 80 i attached to the rotatabletop 80 h and an aim point 180 located at an opposite end of the sling 80i having a pre-set pattern for the image capturing unit 60 to captureand identity the angle of rotation of the rotatable top 80 h and anangle of suspension at which the user aims the sling 80 i to shoot basedon the at least one multimedia 55 being displayed on the display screeninterface 50 of the computing device. Also, the slingshot 80 includesmultiple tag points 170 on the base 80 g which is captured by the imagecapturing unit 60 and is used as a reference point for furtherinteraction of the sling shot 80 with the at least one multimedia 55 onthe display screen interface 50. The further analysis, interaction andtracking of the slingshot 80 is done as described above.

FIG. 6 is a schematic representation of yet another embodiment of theinteractive learning system 150 representing a laptop as the computingdevice, of FIG. 1 in accordance with an embodiment of the presentdisclosure. The image capturing unit 60 is embedded on the displayscreen interface 50 of the laptop 160 b. The one or more interactivetools 80 are placed and operated on the second section 30 b of the pad20. The second section 30 b of the pad 20 is kept in field of view ofthe image capturing unit 60 of the laptop 160 b. The further analysis,interaction and tracking of the interactive tool 80 including multiplerings 80 c and multiple spikes 80 b is done as described above.

FIG. 7 includes FIG. 7a and FIG. 7b which are schematic representationof a system for interactive piano in a front view and a back viewrespectively accordance of an embodiment of the present disclosure. Inone embodiment. the system 150 may include a pad 20 having multiplesections 30. The multiple sections 30 includes a first section 30 aincluding a housing unit 40 which is substantially similar to slot (40of FIG. 1). A display screen interface 50 with an image capturing unit60 is housed within the housing unit 40. In one embodiment, the housingunit 40 includes a spring to hold a display screen interface 50 withinthe housing unit 40. In one embodiment, the image capturing unit 60 maybe a camera embedded within the display screen interface 50 of acomputing device. In one exemplary embodiment, the computing device mayinclude a laptop, a tablet, a mobile device, or the like. The multiplesections 30 may also include a second section 30 b. In one exemplaryembodiment, the second section 30 b is placed at a pre-defined distancefrom the image capturing unit 60, wherein the pre-defined distancecomprises a field of view of the image capturing unit 60.

Furthermore, the system 150 includes an interactive piano 80 j one ofthe one or more interactive tools 80 to enable an interaction with amultimedia 55 being displayed on the display screen interface 50 uponhaving a movement of multiple keys 180 of the interactive piano 80 j. Inone embodiment, the interactive piano 80 j is magnetically coupled tothe second section 30 b. In such embodiment, the interactive piano 80 jmay be magnetically coupled through magnetic material on the secondsection 30 b of the pad 20. In such embodiment, the second section 30 bmay include a pre-defined magnetic pattern which may be embedded withinthe pad 20. Further, the interactive piano 80 j includes multiple keys180.

In one exemplary embodiment, the interactive piano 80 j may include agroove on a top surface 175 In such embodiment, the system 150 mayfurther include one or more interactive instrumental tools 80 kpositioned on the groove. The one or more interactive instrumental tools80 k is operated by the user to select an instrument from a plurality oftype of instruments based on an angle of rotation of the correspondingone or more interactive instrumental tools 80 k on the groove by theuser. In one embodiment, each of the one or more interactiveinstrumental tools 80 k may correspond to one of the multiple type ofinstruments. The multiple type of instruments may include a percussioninstrument, a woodwind instrument, a string instrument or a brassinstrument.

The system 150 further includes one or more processors 90 (as shown inFIG. 2) operatively coupled to the pad 20. The one or more processors 90include a multimedia 55 projection module 100 to project the multimedia55 on the display screen interface 60 upon selection of the multimedia55 by the user. The multimedia 55 is representative of one or moremusical notes for the interactive piano 80 j. Referring to the aboveembodiment, the one or more musical notes may be representative of thetype of the instrument which may be selected by the user via thecorresponding one or more interactive instrumental tools 80.

Furthermore, the one or more processors 90 include an image receivingmodule 110 to receive one or more key images representative of themovement of the multiple keys 180 of the interactive piano 80 j capturedby the image capturing unit 60 in real time. In one embodiment, each ofthe multiple keys 180 represent the corresponding one or more musicalnotes. In one exemplary embodiment, each of the multiple keys 180 mayinclude a point tag 170 on the multiple key 180 which may be designedwith specific dimensions. Further, as the one or more multiple keys 180are operated by the user, an image of the corresponding point tag 170 iscaptured by the image capturing unit 60 and is transmitted to the imagereceiving module 110. In such embodiment, the point tag 170 would befacing the image capturing unit 60 (as shown in FIG. 7a ). FIG. 7a isthe front view of the interactive piano 80 j from the user's view. Thepoint tag 170 in view of the image capturing unit 60 is as shown in FIG.7b . In another exemplary embodiment, the image receiving module 110 mayreceive one or more interactive instrumental images representative ofthe movement of the one or more interactive instrumental tools 80 kcaptured by the image capturing unit 60 in real time.

The one or more processors 90 also includes an image identificationmodule 120 to identify the one or more musical notes formed by the oneor more key images representative of the movement of the correspondingmultiple keys 180 of the interactive piano 80 j received by the imagereceiving module 110. In one exemplary embodiment, the imageidentification module 120 may identify the type of instrument of theplurality of instruments based on the angle of rotation of thecorresponding one or more interactive instrumental tools 80 k on thegroove.

The one or more processors 90 also includes an image analysis module 130to analyse the one or more musical notes identified by the imageidentification module via an image processing technique. Morespecifically, the one or more key images of the multiple keys 180 of theinteractive piano 80 j is operated by the user, and the correspondingone or more key images is captured by the image capturing unit 60 andthe corresponding key tag 170 of each of the multiple keys 180 operatedis identified and analysed to obtain the one or more musical notes.Further, the one or more musical notes analysed is compared withpre-stored musical notes to play the one or more musical notes in realtime. In one embodiment, the computing device may include at least onespeaker through which the one or more musical notes identified may beplayed in real time as and when the user is operating the multiple keyson the interactive piano.

Furthermore, the one or more processors 90 includes a tool interactionmodule 140 to enable an interaction of the interactive piano 80 j withthe multimedia 55 being displayed on the display screen interface 50 inreal time based on the one or more musical notes analysed by the imageanalysis module 130. In one embodiment, the tool interaction module 140may track the movement of the interactive piano 80 j and the one or moreinteractive instrumental tools 80 k based on the one or more musicalnotes analysed.

FIG. 8 is a block diagram of a computer 190 or a server in accordancewith an embodiment of the present disclosure. The server includesprocessors 200, and memory 210 operatively coupled via a bus 220. Theprocessors 200, as used herein, means any type of computational circuit,such as, but not limited to, a microprocessor, a microcontroller, acomplex instruction set computing microprocessor, a reduced instructionset computing microprocessor, a very long instruction wordmicroprocessor, an explicitly parallel instruction computingmicroprocessor, a digital signal processor, or any other type ofprocessing circuit, or a combination thereof.

The memory 210 includes a plurality of modules of a system of FIG. 1 andFIG. 7 in the form of executable program which instructs the processor200 to perform the method steps illustrated in FIG. 9. The memory 210has following modules: a multimedia 55 projection module 100, an imagereceiving module 110, an image identification module 120, an imageanalysis module 130 and a tool interaction module 140.

The multimedia projection module 100 is configured to project the atleast one multimedia on the display screen interface upon selection ofthe at least one multimedia by a user. The image receiving module 110 isconfigured to receive one or more images representative of the at leastone movement of the corresponding one or more interactive tools capturedby the image capturing unit in real time. The image identificationmodule 120 is configured to identify a pattern formed by the one or moreimages representative of the at least one movement of the correspondingone or more interactive tools received by the image receiving module.The image analysis module 130 is configured to analyse the patternidentified by the image identification module via an image processingtechnique. The tool interaction module 140 is configured to enable aninteraction of the one or more interactive tools with the at least onemultimedia being displayed on the display screen interface in real timebased on the pattern analysed by the image analysis module.

Computer memory 210 elements may include any suitable memory devices forstoring data and executable program, such as read only memory, randomaccess memory, erasable programmable read only memory, electricallyerasable programmable read only memory, hard drive, removable mediadrive for handling memory cards and the like. Embodiments of the presentsubject matter may be implemented in conjunction with program modules,including functions, procedures, data structures, and applicationprograms, for performing tasks, or defining abstract data types orlow-level hardware contexts. Executable program stored on any of theabove-mentioned storage media may be executable by the processor(s) 200.

FIG. 9 is a flow chart representing the steps involved in a method 230for interactive learning in accordance with an embodiment of the presentdisclosure. The method 230 includes projecting at least one multimediaon a display screen interface upon selection of the at least onemultimedia by a user in step 240. In one embodiment, projecting the atleast one multimedia includes projecting the at least one multimedia bya multimedia projection module.

The method 230 also includes receiving one or more images representativeof the at least one movement of corresponding one or more interactivetools captured by an image capturing unit in real time in step 250. Inone embodiment, receiving the one or more images may include receivingthe one or more images by an image receiving module. In anotherembodiment, receiving the one or more images may include receiving theone or more images captured by a camera embedded within the displayscreen interface. In one exemplary embodiment, receiving the one or moreimages representative of the at least one movement may include receivingthe one or more images representative of one of a linear movement, acircular movement, a rotational movement or a combination thereof.

In one specific embodiment, receiving the one or more imagesrepresentative of the at least one movement of the corresponding one ormore interactive tools may include receiving the one or more images uponoperating the one or more interactive tools on a second section ofmultiple sections of a pad. In such embodiment, the second section maybe in field of view of the image capturing unit. Also, the imagecapturing unit may be fixed to a slot on a first section of the multiplesections of the pad.

Furthermore, the method 230 includes enabling an interaction with atleast one multimedia being displayed on the display screen interfaceupon having at least one movement of the one or more interactive toolson pad in step 260. In one embodiment, enabling the interaction mayinclude enabling the interaction by one or more interactive tools. Insuch embodiment, enabling the interaction by one or more interactivetools may include enabling the interaction by one of multiple patterns,multiple designs, game equipment or a combination thereof.

The method 230 also includes identifying a pattern formed by the one ormore received images representative of the at least one movement of thecorresponding one or more interactive tools in step 270. In oneembodiment, identifying the pattern may include identifying the patternby an image identification module. In one exemplary embodiment, themethod may further include identifying at least one tag point of thecorresponding one or more interactive tools for obtaining a referencepoint for the interaction of the one or more interactive tools with theat least one multimedia.

The method 230 also includes analysing the pattern identified via animage processing technique in step 280. In one embodiment, analysing thepattern may include analysing the pattern by an image analysis module.The method 230 also includes enabling an interaction of the one or moreinteractive tools with the at least one multimedia being displayed onthe display screen interface in real time based on the pattern analysedin step 290. In one embodiment, enabling the interaction of the one ormore interactive tools may include enabling the interaction by a toolinteraction module. In one exemplary embodiment, the method 230 mayfurther include tracking the at least one movement of the correspondingone or more interactive tool based on the pattern analysed. In suchembodiment, tracking the at least one movement may include tracking theat least one movement by the tool interaction module.

In one embodiment, the method 230 may further include generating anotification when the one or more interactive tools are not in a fieldof view of the image capturing unit. In such embodiment, generating thenotification may include generating one of a text notification, a voicenotification, a multimedia notification or the like.

Various embodiments of the present disclosure enable the interactivelearning system to enable the user to have a hands-on experience withthe interaction associated to education or entertainment through theinteractive tool and the display screen interface. Also, the userexperience is limited extended to multiple approaches, thereby makingthe system more reliable. Also, accuracy of tracking the interactivetools in real time is high due to implementation of different imageprocessing techniques.

Also, the system adapts to different in-room lighting conditions toimprove detection of the interactive tools. The system also detectssequential addition and deletion of the interactive tools which enablesin understanding which interactive tool was recently added or removed.The detection of the interactive tool helps in identifying faded ormisprinted interactive tool by generating a notification to the user,thereby helping the user to replace the tool. In addition, the systemalso detects movement of tactile elements to keep a track on the userinput. The system also detects movement of tactile elements to see the360° orientation of the tactile element.

Further, as the system also generated the notification if theinteractive tool is outside or partially within the field of view,thereby making the system more reliable. The system also detects andtracks multiple interactive tools, detects any movement or misplacementof the pad or/and the interactive tool from the field of view of theimage capturing unit which enable accuracy in detection and interactionof the interactive tool with the at least one multimedia on the displayscreen interface. Also, the system uses colour in the one or more imagescaptured, also detects the face and scans the detected face of thecorresponding interactive tool. Also, the display screen interface isoriented between 85-90 degree, which is almost in the up-right position.As used herein, the term ‘face’ is defined as a side of the interactivetool.

While specific language has been used to describe the disclosure, anylimitations arising on account of the same are not intended. As would beapparent to a person skilled in the art, various working modificationsmay be made to the method in order to implement the inventive concept astaught herein.

The figures and the foregoing description give examples of embodiments.Those skilled in the art will appreciate that one or more of thedescribed elements may well be combined into a single functionalelement. Alternatively, certain elements may be split into multiplefunctional elements. Elements from one embodiment may be added toanother embodiment. For example, order of processes described herein maybe changed and are not limited to the manner described herein. Moreover,the actions of any flow diagram need not be implemented in the ordershown; nor do all of the acts need to be necessarily performed. Also,those acts that are not dependent on other acts may be performed inparallel with the other acts. The scope of embodiments is by no meanslimited by these specific examples.

We claim:
 1. An interactive learning system comprising: a pad comprising a plurality of sections, wherein the plurality of sections comprises: a first section comprising a slot, wherein a display screen interface comprising an image capturing unit is housed within the slot; and a second section; one or more interactive tools operatively coupled to the second section, wherein the one or more interactive tools are configured to enable an interaction with at least one multimedia being displayed on the display screen interface upon having at least one movement of the one or more interactive tools on the second section of the pad; and one or more processors operatively coupled to the pad, wherein the one or more processors comprises: a multimedia projection module configured to project the at least one multimedia on the display screen interface upon selection of the at least one multimedia by a user; an image receiving module configured to receive one or more images representative of the at least one movement of the corresponding one or more interactive tools captured by the image capturing unit in real time; an image identification module configured to identify a pattern formed by the one or more images representative of the at least one movement of the corresponding one or more interactive tools received by the image receiving module; an image analysis module configured to analyze the pattern identified by the image identification module via an image processing technique; and a tool interaction module configured to enable an interaction of the one or more interactive tools with the at least one multimedia being displayed on the display screen interface in real time based on the pattern analyzed by the image analysis module.
 2. The interactive learning system as claimed in claim 1, wherein the image capturing unit comprises a camera embedded within the display screen interface.
 3. The interactive learning system as claimed in claim 1, wherein the second section is placed at a pre-defined distance from the image capturing unit, wherein the pre-defined distance comprises a field of view of the image capturing unit.
 4. The interactive learning system as claimed in claim 1, wherein the slot comprises a spring configured to hold the display screen interface within the slot.
 5. The interactive learning system as claimed in claim 1, wherein the one or more interactive tools comprises one of a plurality of patterns, a plurality of designs, game equipment or a combination thereof.
 6. The interactive learning system as claimed in claim 1, wherein the one or more interactive tools comprises at least one tag point, wherein the at least one tag point is placed in sync with corresponding one or more mark points to create a reference point for the interaction of the one or more interactive tools with the at least one multimedia.
 7. The interactive learning system as claimed in claim 1, wherein the tool interaction module is configured to track the at least one movement of the corresponding one or more interactive tool based on the pattern analysed by the image analysis module.
 8. A method for interactive learning comprising: projecting, by a multimedia projection module, at least one multimedia on a display screen interface upon selection of the at least one multimedia by a user; receiving, by an image receiving module, one or more images representative of the at least one movement of corresponding one or more interactive tools captured by an image capturing unit in real time, wherein receiving the one or more images representative of the at least one movement of corresponding one or more interactive tools comprises: enabling, by one or more interactive tools, an interaction with at least one multimedia being displayed on the display screen interface upon having at least one movement of the one or more interactive tools on pad; identifying, by an image identification module, a pattern formed by the one or more received images representative of the at least one movement of the corresponding one or more interactive tools; analyzing, by an image analysis module, the pattern identified via an image processing technique; and enabling, by a tool interaction module, an interaction of the one or more interactive tools with the at least one multimedia being displayed on the display screen interface in real time based on the pattern analyzed.
 9. The method as claimed in claim 8, wherein receiving the one or more images representative of the at least one movement of the corresponding one or more interactive tools captured by the image capturing unit in real time comprises receiving the one or more images captured by a camera embedded within the display screen interface.
 10. The method as claimed in claim 8, further comprises tracking, by the tool interaction module, the at least one movement of the corresponding one or more interactive tool based on the pattern analysed.
 11. A system for interactive piano comprising: a display screen interface comprising an image capturing unit housed within a housing unit; an interactive piano operatively coupled to the display screen, wherein the interactive piano comprises a plurality of keys, the interactive piano configured to enable an interaction with a multimedia being displayed on the display screen interface upon having a movement of the plurality of keys of the interactive piano; and one or more processors operatively coupled to the interactive piano, wherein the one or more processors comprises: a multimedia projection module configured to project the multimedia on the display screen interface upon selection of the multimedia by a user, wherein the multimedia is representative of one or more musical notes of the interactive piano; an image receiving module configured to receive one or more key images representative of the movement of the plurality of keys of the interactive piano captured by the image capturing unit in real time; an image identification module configured to identify the one or more musical notes formed by the one or more key images representative of the movement of the corresponding plurality of keys of the interactive piano received by the image receiving module; an image analysis module configured to analyze the one or more musical notes identified by the image identification module via an image processing technique; and a tool interaction module configured to enable an interaction of the interactive piano with the multimedia being displayed on the display screen interface in real time based on the one or more musical notes analyzed by the image analysis module.
 12. The system as claimed in claim 11, wherein the image capturing unit comprises a camera embedded within the display screen interface.
 13. The system as claimed in claim 11, wherein the housing unit comprises a spring configured to hold the display screen interface within the housing unit.
 14. The system as claimed in claim 11, wherein the tool interaction module is configured to track the movement of the corresponding plurality of keys of the interactive piano based on the one or more musical notes analysed by the image analysis module.
 15. The system as claimed in claim 11, wherein the interactive piano comprises a groove.
 16. The system as claimed in claim 15, further comprises one or more interactive instrumental tools positioned on the groove, wherein the one or more interactive instrumental tools is operated by the user to select an instrument from a plurality of type of instruments based on an angle of rotation of the corresponding one or more interactive instrumental tools on the groove by the user.
 17. The system as claimed in claim 16, wherein each of the one or more interactive instrumental tools corresponds to one of the plurality of type of instruments, wherein the plurality of type of instruments comprises a percussion instrument, a woodwind instrument, a string instrument or a brass instrument.
 18. The system as claimed in claim 16, wherein the image receiving module is configured to receive one or more interactive instrumental images representative of the movement of the one or more interactive instrumental tools captured by the image capturing unit in real time.
 19. The system as claimed in claim 16, wherein the image identification module is configured to identify the type of instrument of the plurality of instruments based on the angle of rotation of the corresponding one or more interactive instrumental tools on the groove by the image receiving module.
 20. The system as claimed in claim 11, wherein the tool interaction module configured to enable the interaction of the interactive piano with the multimedia being displayed on the display screen interface in real time based using one of a virtual reality technique, an augmented reality technique or a mixed reality technique. 